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An  Analysis  of  Voice  Communication 
IN  A  Simulated  Approach  Control  Environment 


Words  differently  arranged  have  a  different  meaning,  and 
meanings  differently  arranged  have  different  effects. 

—  Pascal 


1.0  INTRODUCTION 

Accurate  communication  between  air  traffic  con¬ 
trol  specialists^  and  pilots  is  essential  to  air  safety  (see 
Prinzo  &  Britton,  1993  for  a  review  of  the  literature). 
To  gain  a  better  understanding  of  the  problems  that 
arise  from  spoken  communication,  analyses  on  the 
message  contents  and  acoustic  properties  of  speech  are 
often  performed.  The  results  from  those  analyses 
range  from  describing  current  communication  prac¬ 
tices  among  pilots  and  controllers  to  determining 
causal  factors  in  accident  investigations. 

Researchers  and  investigators  who  perform  mes¬ 
sage  content  analyses  often  develop  their  own  classifi¬ 
cation  schemes  to  identify  patterns  of  communication 
and  organize  similar  communication  problems  into 
categories.  Message  content  analyses  were  recently 
performed  on  field  tapes  obtained  from  various  air 
traffic  control  (ATC)  facilities  (en  route,  Cardosi 
1993;  tower,  Burki-Cohen  1995;  terminal.  Morrow, 
Lee,  &  Rodvold,  1993;  Cardosi,  Brett,  &  Han,  1996; 
Prinzo  1996)  and  cockpit  voice  recorder  transcripts 
obtained  from  the  National  Transportation  Safety 
Board  (Helmreich  1994;  Predmore  1991).  Generally, 
the  results  indicate  that  clearances  and  instructions 
make  up  the  largest  proportion  of  communication 
between  controllers  and  pilots. 

Typically,  acoustical  analyses  examine  the  frequency 
spectrum  and  temporal  amplitude  of  identical  words 
or  parts  of  words  spoken  by  the  same  person  at 
different  times  to  determine  whether  changes  are 
present  (Mayer,  Brenner,  &  Cash,  1996).  These 
changes  might  serve  as  markers  or  indicators  of  stress 
(Brenner,  Shipp,  Doherty,  &  Morrissey,  1985;  Griffin 


&  Williams,  1987)  or  physiological  change 
(Lieberman,  Protopapas,  &  Kanki,  1995).  Generally, 
a  frequency  shift  to  the  right  (pitch  gets  higher)  is 
indicative  of  emotional  stress  and  a  shift  to  the  left 
(pitch  gets  deeper)  indicates  stress-reduction.  Brenner, 
Doherty,  and  Shipp  (1994)  analyzed  crew  conversa¬ 
tions  recorded  during  routine  and  emergency  situa¬ 
tions.  In  all  of  the  tapes,  the  fundamental  frequency 
(pitch)  increased  significantly  during  emergency  air 
to  ground  communications. 

Frequently,  the  research  question  and  paradigm 
direct  the  manner  in  which  data  are  selected,  col¬ 
lected,  extracted,  and  analyzed  (see  Kanki  &  Prinzo, 
1 996) .  As  long  as  these  paradigms  and  their  associated 
protocols  lead  researchers  and  investigators  to  view- 
aspects  of  the  same  event  differently,  conflicting  in¬ 
terpretations  may  occur.  The  lack  of  standardized 
metrics  and  representative  measures  can  be  problem¬ 
atic  for  many  reasons.  First,  the  comparison  of  results 
obtained  from  one  laboratory  to  that  of  another  is 
difficult  or  impossible  to  perform.  Second,  the  results 
obtained  by  one  laboratory  can  be  difficult  to  replicate 
because  the  encoding  process  may  not  be  consistent. 
Finally,  the  results  and  conclusions  made  by  research¬ 
ers  and  investigators  often  are  difficult  to  translate 
into  a  curriculum  or  instructional  practice.  Fortu¬ 
nately,  when  communicating  with  pilots,  controllers 
are  required  to  use  the  phraseology  presented  in  FAA 
Order  7110.65  Air  Traffic  ControP  as  the  standard. 
Researchers  also  can  apply  it  to  the  analysis  of  ATC 
communication. 


*  Air  traffic  control  specialists  may  be  referred  to  as  controllers,  specialists,  or  ATCSs  in  this  document. 
^  For  brevity,  the  publication  will  be  referred  to  as  FAA  Order  7110.65  throughout  this  document. 
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Prinzo,  Britton,  and  Hendrix  (1995)  developed  the 
aviation  topics  speech  acts  taxonomy  (ATSAT)  to 
analyze  communication  elements^  in  accordance  with 
FAA  Order  7110, 65  and  the  Aeronautical  Information 
Manual  (AIM)^.  Both  were  used  to  identify  irregulari¬ 
ties  in  spoken  communication  such  as  grouping  num¬ 
bers  together  when  they  should  be  spoken  sequentially 
or  omitting,  substituting,  or  adding  words  contrary  to 
required  phraseology.  These  irregularities  constitute 
departures  from  the  standard  phraseology  specified  in 
FAA  Order  71 1 0.65  and  will  be  referred  to  as  irregular 
communication  (IC)  in  this  report. 

Communication  elements  combine  to  form  mes¬ 
sages  that  are  transmitted  over  voice  radio  or  data  link 
communications  systems  (Prinzo  1996).  One  com¬ 
monly  referenced  communication  element  is  the  speech 
act  (Searle,  1969;  Kanki  &:  Foushee,  1989)  which 
Prinzo  defines  as  an  utterance,  either  spoken  or  writ¬ 
ten,  which  describes  or  suggests  one  discourse  func¬ 
tion.  There  are  five  speech  act  categories  in  the  ATSAT : 
Address,  Instruction,  Advisory,  Request,  and  Cour¬ 
tesy.  A  sixth  category,  Non-codable,  was  included  for 
communication  elements  that  could  not  be  catego¬ 
rized  (the  communication  element  could  be  an  in¬ 
complete  phrase  or  be  unintelligible).  The  aviation 
topic  is  the  subject  matter  of  the  speech  act.  It  places 
a  constraint  on  the  communication  element  by  im¬ 
posing  a  restriction  on  its  identified  speech  act  cat¬ 
egory.  For  example,  there  are  only  two  types  of  aviation 
topics  in  the  Address  speech  act  category:  one  identi¬ 
fies  the  speaker  and  the  other  identifies  the  receiver  of 
a  transmission. 

To  illustrate,  consider  the  transmission,  ''[Name] 
Approach,  Universal  744  descend  and  maintain  niner 
thousand.  "It  contains  three  communication  elements. 
[Name]  Approach  and  Universal  744  identify  the  par¬ 
ticipants;  each  is  tagged  with  the  speech  act  category, 
Address.  The  aviation  topic  distinguishes  one  Address 
from  the  other  by  identifying  "[Name]  Approach''  zs 
the  Speaker  and  "Universal  744"  zs  the  Receiver  of  the 
transmission.  The  third  communication  element, 
"descend  and  maintain  niner  thousand,"  an  Instruc¬ 
tion  speech  act,  and  its  aviation  topic  identifies  it  as  an 
altitude. 

Recently,  Prinzo  ( 1996)  performed  a  content  analy¬ 
sis  of  ATC  communications  from  field  tapes  provided 
by  several  terminal  approach  control  (TRACON) 


facilities.  The  field  tapes  were  used  to  develop  a 
baseline  database  of  typical  controller  and  pilot  voice 
communications.  The  results  of  that  analysis  found 
that  2,500  of  6,300  (40%)  controller  communication 
elements  contained  at  least  one  irregularity.  For  con¬ 
trollers,  93%  of  those  irregularities  occurred  in  the 
Instruction  (55%),  Advisory  (24%),  and  Address 
(14%)  speech  act  categories.  Of  5,900  pilot  commu¬ 
nication  elements,  3,500  (59%)  contained  at  least  one 
irregular  communication.  For  pilots,  96%  of  their 
irregular  communications  involved  the  Instruction 
(53%),  Address  (25%),  and  Advisory  (18%)  speech 
acts  categories.  Irregular  communication  involved 
call  sign  ambiguity,  call  sign  confusion,  two  aircraft 
on  frequency  talking  to  each  other,  report  of  an 
emergency  locator  transmitter  (ELT),  open  mike, 
traffic,  weather,  and  others.  The  communication  prob¬ 
lems  resulted  in  a  loss  of  efficiency  but  did  not  result 
in  hazardous  consequences,  such  as  loss  of  separation. 

Based  on  telephone  interviews  with  pilots  and  the 
content/acoustic  analyses  of  field  tapes,  several  re¬ 
searchers  have  attempted  to  identify  some  of  the 
correlates  and  causes  of  communication  problems. 
Morrison  and  Wright  (1989)  and  Morrow,  Rodvold, 
and  Lee  (1994)  report  that  miscommunications  tend 
to  occur  more  often  when  controllers  experience  over¬ 
load  due  to  heavy  traffic,  frequency  congestion,  mes¬ 
sage  length,  etc.  Three  voice  qualities  appear  to  vary 
systematically  with  workload:  pitch,  loudness,  and 
rate  of  speech.  For  example,  Griffin  and  Williams 
(1987)  reported  that  people  under  emotional  stress  or 
increased  task  complexity  have  a  higher  pitch  and  they 
tend  to  talk  louder  and  faster.  Brenner  et  al.,  (1994) 
indicate  that  mental  workload  also  appeared  to  pro¬ 
duce  similar  effects  on  language  production. 

To  gain  a  better  understanding  of  the  relationship 
between  workload  and  ATC  communication,  a  simu¬ 
lation  study  was  designed  to  examine  the  relationship 
between  workload  and  the  efficiency  and  accuracy  of 
controller  voice  communication.  Two  components  of 
controller  voice  communication,  message  content  and 
speech  production,  were  examined.  An  acoustic/pho¬ 
netic  analysis  was  performed  on  the  controller  voice 
characteristics  thought  to  be  associated  with  changes 
in  workload.  The  results  of  that  analysis  are  presented 
in  Prinzo,  Lieberman,  and  Pickett  (in  review). 


^  The  communication  element  is  conceptualized  as  a  fundamental  unit  of  meaningful  verbal  language. 
^  Previously  called  x\it  Airman's  Information  Manual. 
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The  results  that  are  presented  in  this  report  are 
limited  to  a  discussion  of  the  analysis  performed  on 
the  message  content  of  controller  transmissions.  Full 
performance  air  traffic  control  specialists  were  re¬ 
cruited  from  two  terminal  radar  approach  control 
(TRACON)^  facilities  to  participate  in  this  study. 
They  provided  radar  separation  for  simulated  aircraft 
during  periods  of  typical  low  and  high  traffic  that 
represented  actual  traffic  counts  at  their  respective 
facilities.  Recorded,  digitized  pilot  messages  were 
generated  by  a  TRACON  simulator  in  response  to 
communications  initiated  by  the  controller.  If  the 
simulator  failed  to  generate  an  appropriate  pilot  re¬ 
sponse,  a  certified  'ghost  pilot  "’from  the  FAA  Acad¬ 
emy  intervened  with  the  correct  response.  Simulated 
communications  were  analyzed  in  accor¬ 
dance  with  the  procedures  outlined  in  Prinzo 
et  al.  (1995).  Communication  irregulari¬ 
ties  were  identified  and  statistically  com¬ 
pared  with  irregular  communications 
identified  from  field  tapes  obtained  from 
two  approach  control  facilities.  If  the  re¬ 
sults  could  be  replicated  in  a  simulation  envi¬ 
ronment,  then  they  could  generalize  to  and 
have  relevance  in  real-world  applications. 

2.0  METHOD 

2.1  Participants 

Twenty-four  full  performance  level  (FPL) 
controllers  from  two  TRACON  facilities 
completed  this  study.  One  facility  pro¬ 
vided  9  male  and  3  female  controllers.  Col¬ 
lectively,  they  had  13.17  mean  years  of 
terminal  experience  (SD  =  3.49)  with  9.88 
mean  years  (SD  =  3.19)  at  the  FPL.  The 
other  facility  provided  10  male  and  2  fe¬ 
male  controllers  who,  on  the  average,  had 
12.13  years  of  experience  (SD  =  3.16)  with  10.04 
mean  years  at  the  FPL  (SD  =  3.20)  and  1 1.30  mean 
years  working  as  terminal  controllers  (SD  =  2.63). 

2.2  Equipment 

2.2.1  TRACON  and  Ghost  Pilot  Workstations. 
Wesson  InternationaPs  TRACONpro®  software  was 
installed  on  two  486/66  MHz  DX2  personal  comput¬ 
ers.  Each  workstation  displayed  radar  traffic  on  a  21  ” 


multi-scanning  capable  monitor  (1280x1024x256) 
with  high-resolution  video  adapters.  The  TRACON 
workstation  included  an  amber  14"  monitor  for  dis¬ 
playing  ATIS,  a  track  ball  and  ARTSIIIA-simulated 
keyboard,  standard  101 -style  keyboard,  Verbex  6000 
Voice  Systems  continuous  voice  recognition  “slave” 
computer  board,  push-to-talk  headset,  and  Sound¬ 
Blaster  16-bit  digitized  sound  board.  Figure  1  shows 
several  TRACON  workstations  in  use.  The  ghost 
pilot  workstation  included  a  standard  101-style  key¬ 
board  and  computer  mouse.  The  TRACON  work¬ 
station  was  housed  in  a  room  separate  from  the 
ghost  pilot  workstation.  The  workstations  com¬ 
municated  with  each  other  through  a  LANtastic 
network  operating  system. 


2.2.2Video  Recording  Equipment.  A  Sony 
Handycam  CCD-TR81  video  Hi8  Camcorder, 
mounted  on  a  Bogen  3165  tripod,  was  positioned 
approximately  4  meters  to  the  left  and  6  meters  in 
front  of  the  controller’s  workstation.  Only  the  radar 
display,  side  view  of  the  controller,  and  hand  move¬ 
ments  were  recorded.  The  audio/video  output  of  the 
Sony  Handycam  was  routed  to  a  Panasonic  audio/ 
video  distribution  amplifier  (15-1103),  displayed  on 


Figure  1.  TRACONpro  simulator 


^  A  terminal  radar  approach  control  (TRACON)  facility  is  associated  with  an  air  trafficcontrol  tower  that  uses  radar  to  provide  approach 
control  services  to  aircraft. 
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a  Sony  color  video  monitor  PVM2530,  equipped  with 
2  Sony  SS'X6A  speakers,  and  recorded  by  a  Sony 
video  cassette  recorder  SVO-1610  on  standard  VHS 
T120  cassettes. 

2.2.3Audio  Recording  Equipment.  A  Sony  Elec- 
tret  condenser  microphone  (ECM-77B)  was  attached 
to  a  Shurlite  headset  and  positioned  approximately 
1 . 5cm  from  the  controller’s  lips.  The  output  signals  of 
the  microphone  were  amplified  by  a  Panasonic  audio 
mixer  WR-450  and  then  sent  to  a  Sony  digital  audio 
recorder  PCM-2700,  where  each  utterance  was  time 
stamped  and  recorded  on  120-minute  BASF  DAT 
cassettes. 

2.3  Simulation  Support  Staff 

The  simulation  support  staff  consisted  of  one  ghost 
pilot,  a  retired  controller,  and  several  representatives 
from  each  TRACON  facility.  The  certified  ghost  pilot 
from  the  FAA  Academy  was  trained  on  the  scenarios 
constructed  for  this  experiment.  A  recently  retired 
FPL  controller  served  as  the  subject  matter  expert 
(SME).  He  constructed  the  scenarios,  trained  the 
ghost  pilot  on  the  TRACONpro  system  and  sce¬ 
narios,  developed  briefing  materials,  and  provided  the 
ghost  pilot  with  on-line  instruction  during  each  simu¬ 
lation.  Several  staff  members  from  each  TRACON 
facility  provided  subject  matter  expert  information 


and  guidance  during  the  development  of  the  airspace, 
procedures,  and  scenarios.  Also,  prior  to  the  onset  of 
the  experiment,  several  controllers  reviewed  and  of¬ 
fered  suggestions,  which  increased  the  fidelity  and 
realism  of  each  scenario. 

2.4  Materials 

2.4.1  Scenario  Construction.  The  number  of  air¬ 
craft  requiring  radar  service  was  experimentally  ma¬ 
nipulated  to  simulate  high-  and  low-workload 
scenarios.  For  example,  light  traffic  density  at  one  of 
the  TRACON  facilities  averaged  approximately  1.5 
aircraft  communicating  with  approach  control  per 
minute,  and  heavy  traffic  averaged  2  aircraft  commu¬ 
nicating  with  the  controller  per  minute.  Three  con¬ 
troller  positions  from  each  facility  were  simulated. 
T raffic  density  was  crossed  with  controller  position  to 
produce  6  scenarios  for  each  facility. 

2.42  Ghost  Pilot  Communication  Scripts.  Based 
on  field  tape  analyses,  normal  and  problematic  pilot 
communication  scripts  were  constructed  and  fully 
counter-balanced  for  use  in  each  scenario.  The  scripts 
were  used  by  the  ghost  pilot,  who  initiated  calls  to 
ATC  at  pre-determined  times  and  responded  to  mes¬ 
sages  generated  by  the  controller.  The  problematic 
transmissions  that  were  incorporated  in  the  commu¬ 
nications  are  presented  in  Table  1. 


Table  1 .  Target  Aircraft  Transmissions  Made  by  the  Ghost  Pilot  to  Controllers 
Target  Pilot  Transmissions  to  Controllers  at  TRACON  Facility  1 

I  wanna  confirm  we  are  going  to  runway  "3”  "5"  right. 

Verify  the  altimeter  is  ”3"  "0"  "0"  ”4"  and  our  runway  assignment  is  “3"  "1"  right. 

Give  us  the  wind  and  altimeter  again  and  we  would  like  to  land  "1"  "8"  right. 

Can  I  reduce  down  to  "1 "  "9"  "0"  knots  on  account  of  the  chop? 

Is  it  OK  if  we  reduce  to  "2"  "1 "  "0"  now? 

Request  runway  ”1 "  "3"  right  if  it’s  not  too  much  of  a  problem  for  you. 

Target  Pilot  Transmissions  to  Controllers  at  TRACON  Facility  2 

(Name)  Approach,  any  chance  landing  north  today  for  "3"  "5"  left? 

(Name)  Approach,  I’d  like  to  request  the  ILS  "1"  "7"  on  the  right  with  a  full  stop  at  (airport  name). 
Request  ILS  approach  at  (airport  name). 

Requesting  an  ILS  runway  "I”  "7"  right  approach. 

Request  runway  ”3"  "5"  right  ILS  approach. 

Sir,  we’d  like  to  make  a  missed  approach  this  afternoon  and  we’ll  just  come  back  for  the  localizer. 
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Upon  initial  contact,  the  ghost  pilot  reported  the 
aircraft  call  sign  and  current  altitude  to  the  controller. 
Once  radar  contact  was  established,  the  ghost  pilot 
made  a  request  for  a  lower  altitude  or  particular 
runway.  In  addition  to  requests,  a  rule  was  established 
that  every  other  ghost  pilot  response  would  include  a 
realistic,  yet  incorrect  readback. 

2.4.3Computer-Generated  Pilot  Responses.  Each 
non-target  aircraft  computer-generated  pilot  response 
(CGPR)  was  created  by  the  TRACONpro  software. 
Each  aircraft  call  sign,  the  (International  Civil  Avia¬ 
tion  Organization)  ICAO  phonetic  alphabet,  and 
phrases  used  in  operational  communications  were 
recorded,  edited,  and  stored  as  SoundBlaster  wave 
files.  The  intelligibility  of  the  CGPRs  was  evaluated 
by  the  Federal  Bureau  of  Investigation  (FBI)  Speech 
Processing  Laboratory  at  Quantico,  VA.  A  CGPR  was 
selected  at  random  and  compared  with  the  same 
message  recorded  live  by  the  originator  of  both  mes¬ 
sages.  The  spectrograms  were  judged  to  be  the  same. 

2.5  Procedure 

Upon  arrival  at  the  TRACON  simulation  labora¬ 
tory,  the  controller  was  told  the  purpose  of  the  study, 
instructed  on  Verbex  voice  training  procedures,  com¬ 
pleted  voice-training  on  a  limited  vocabulary,  and 
gained  familiarity  and  experience  with  the  voice  rec¬ 
ognition  system.  It  took  approximately  2-3  hrs.  to 
complete  voice  training.  Once  voice  trained,  the  con¬ 
troller  completed  a  15-niinute  practice  scenario  at 
which  time  the  SME  determined  whether  additional 
voice  training  or  practice  was  warranted. 

On  the  second  and  third  day,  the  controller  again 
completed  the  same  practice  problem  to  re-establish 
baseline  performance  and  then  completed  a  45'minute 
simulation,  received  a  1  S-minute  break  while  the  next 
scenario  was  loaded,  and  so  on  until  each  of  6  sce¬ 
narios  was  completed.  Using  standard  FAA  phraseol¬ 
ogy,  the  controller  provided  ATC  services  to  all  arrival 
aircraft  within  the  controller’s  area  of  jurisdiction. 
The  following  constraints  were  imposed  on  the  order 
of  scenario  presentation:  (1)  The  controller  did  not 
receive  3  consecutive  heavy  traffic  volume  scenarios, 
(2)  the  controller  provided  ATC  service  on  each  of  the 


3  positions  before  working  the  same  position  again, 
and  (3)  all  controllers  worked  the  FINAL  or  AR2 
position  first. 

2.6  Data  Encoding  Tool  and  Procedure 

2.6.1  Aviation  Topics  Speech  Acts  Taxonomy 
(ATSAT).  The  ATSAT  is  a  tool  for  categorizing  pilot/ 
controller  communications  according  to  their  pur¬ 
pose,  operation,  or  action  and  for  classifying  Irregular 
Communications  (IC)  (Prinzo,  Britton  &  Hendrix, 
1995).  Aviation  topics  are  the  subject  matter  of  speech 
acts.  The  speech  act  categories  and  aviation  topics  are 
presented  in  Table  2. 

There  are  two  categories  of  ICs  presented  in  Table 
3:  non-standard  phraseology  and  delivery  technique. 
Non-standard  phraseology  pertains  to  the  use  of  words 
and/or  phrases  other  than  those  prescribed  in  FAA 
Order  71 10. 65\  delivery  technique  refers  to  stammers, 
stutters,  or  misspoken  words.  ICs  may  or  may  not  lead 
to  the  occurrence  of  an  operational  error,  pilot  devia¬ 
tion,  or  mishap.  The  reader  is  cautioned  NOT  to  make 
the  improper  inference  that  an  IC  is  in  any  way  related 
to  an  operational  error  in  this  report.  Operational  errors 
will  not  be  presented  nor  discussed. 

2.6.2Aviation  Topics  Speech  Act  Taxonomy^^. 
ATSAT  ^  (Prinzo  &  MacLin,  1996)  is  a  computerized 
version  of  ATSAT  .  It  was  used  to  post  transcribed 
data  into  a  pre-defined  electronic  spreadsheet  accord¬ 
ing  to  the  procedures  outlined  in  Prinzo,  et  al.  (1995). 

2.7  Data  Encoding  Procedure 

Transmissions  between  controllers  and  pilots  were 
transcribed  verbatim  by  one  SME  and  then  encoded 
by  another  who  parsed  each  transmission  into  com¬ 
munication  elements  and  classified  them  into  speech 
acts  and  aviation  topics.  Communication  elements 
that  deviated  from  standard  communication  practices 
specified  in  FAlA  Order  7110.65  were  identified  using 
the  IC  codes  included  in  the  ATSAT^.  The  context  in 
which  the  transmission  was  spoken  was  vital  to  how 
the  SME  encoded  the  communication  elements. 

2.7.1  Intercoder  Reliability.  Intercoder  reliability 
was  assessed  by  computing  the  percentage  agreement 
between  the  segmentation,  categorization,  and 


^  Pilots  are  not  required  to  use  the  same  standard  phraseology  as  controllers  when  communicating.  To  achieve  a  standard  for  comparison 
between  pilot  and  controller  communications,  the  following  rule  was  established:  If  a  pilot  attempted  a  verbatim  readback  of  a 
controller’s  transmission,  then  the  same  coding  procedures  that  were  used  on  controllers  transmissions  were  applied  to  the  pilot’s 
verbatim  readback. 
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TABLE  2.  Aviation  Topics/Speech  Acts  Taxonomy 


Speech  Act  Category 

Address/Addressee 

Courtesy 

Instruction/Clearance-- 

Readback/Acknowledgment 


Advisory/Remark-- 

Readback/Acknowledgment 


Request-Readback/Acknowledgment 


Non-Codable  Remarks 


Aviation  Topics _ 

Speaker,  Receiver 

Thanks,  Greetings,  Apology 

Heading,  Heading  Modification,  Altitude,  Altitude 
Restriction,  Speed,  Approach/Departure,  Frequency 
Holding,  Route/Position,  Transponder  Code,  General 
Acknowledgment 

Heading,  Heading  Modification,  Altitude,  Altitude 
Restriction,  Speed,  Approach/Departure,  Route/Position, 
NOTAM,  ATIS,  Weather,  Sighting,  Traffic,  General 
Acknowledgment 

Heading,  Altitude,  Speed,  Approach/Departure, 
Route/Position,  Type,  NOTAM,  Weather,  Traffic,  Say 
Again,  General  Acknowledgment 

Equipment,  Delivery,  Other 


TABLE  3.  Types  of  Irregular  Communications  in  ATC/Piiot  Transcripts 
Types  of  1C  Code  Definition 


Non-Standard  Phraseology 


Grouped 

G 

Grouping  of  numerical  information  contrary  to  paragraph  2-85, 

FAA  Order  71 10.65G. 

Sequential  (Non- 
grouped) 

N 

Failure  to  group  numbers  in  accordance  with  paragraphs  2-87,  2- 
88,  2-90,  and  non-use  of  the  phonetic  alphabet  in  accordance 
with  paragraph  2-84,  FAA  Order  71 10. 65G. 

Omission 

0 

Leaving  out  number(s),  letter(s),  word(s),  prescribed  in 
communication  requirements  in  FAA  Order  7110. 65G. 

Substitution 

S 

Use  of  word(s)  or  phrases(s)  in  lieu  of  communication  outlined  in 
FAA  Order  71 10.65G  (e.g.,  “verify  altitude”  vs.  “say  altitude”). 

T  ransposition 

T 

Number(s)  or  word(s)  used  in  the  improper  order  (e.g.,  “Universal 
six  forty-five”  instead  of  “Universal  five  forty-six”). 

Excessive  Verbiage 

E 

Adding  word(s)  or  phrase(s)  to  communication  outlined  in  FAA 
Order  7110.65G,  and  the  communication  suggested  in  the 
Aeronautical  Information  Manual  (e.g.,  “Universal  the  number 
one  airline  six  forty-five”). 

Partial  Readback’ 

P 

Pilot  report  or  readback  that  does  not  include  specific  reference 
to  a  topic  subject  (e.g.,  altitude  topic  “out  of  six  for  four”  would  be 
recorded  as  a  P.). 

Delivery  Technique 

Dysfluency 

D 

Pause(s),  stammer(s),  utterance(s),  that  add  no  meaning  to  the 
message  (e.g.,  “uh,”  “ah,”  or  “OK”  when  not  used  as  a  General 
Acknowledgment. 

Misarticulation 

M 

Improperly  spoken  words  (i.e.,  slurs,  stutters,  mumbling,  etc.). 

Note:  A  verbatim  readback  of  a  controller’s  instruction  or  advisory  would  not  be  recorded  as  a  P; 
nor  would  a  readback  containing  a  General  Acknowledgment  and  the  aircraft  identifier. 


6 


codification  of  290  communication  elements  within 
120  transmissions  by  the  SME  and  one  of  the  authors 
of  the  ATSAT^.  If  their  encoding  of  a  communication 
element  matched,  it  received  a  value  of  1;  otherwise  a 
0  was  assigned.  Percentage  agreement  was  defined  as: 
Percentage  agreement  = 

Z  concordant  pairs  of  communications  elements 
Z  communication  elements 

There  was  98%  agreement  for  segmentation  of  the 
entire  message  into  identical  communication  elements 
and  96%  agreement  for  classification  of  communica¬ 
tion  elements  in  the  same  speech  act  category  and 
aviation  topic. 

The  identical  match  criterion  for  IC  codes  was 
stringent.  It  required  that  both  SMEs  assigned  a 
communication  element  the  same  type  and  number  of 
IC  codes.  For  example,  there  are  two  communication 
elements  in  the  transmission,  American  (uh)  five  five 
one  /  fly  heading  zero  one  zero.  Both  SMEs  might 
encode  the  '«A'Tn  the  first  communication  element 
as  a  Dysfluency;  and  only  one  encode  five  five  one^'zs 
Sequential  (non-grouped).  In  such  a  case,  the  com¬ 
munication  element  received  a  value  of  0.  There  was 
81%  agreement  for  selection  of  the  same  IC  code 
associated  with  a  communication  element. 

3.0  RESULTS 

The  results  of  the  analysis  performed  on  the  com¬ 
munication  elements  are  presented  in  three  sections. 
In  Section  3. 1 ,  all  of  the  communication  elements  are 


presented  by  speech  act  category.  In  Section  3.2, 
communication  elements  that  contained  irregular 
communications  are  presented  by  speech  act  category. 
In  Section  3.3,  the  communication  elements  that 
contained  irregular  communications  were  analyzed 
according  to  their  speech  act  category  using  non- 
parametric  and  descriptive  statistics. 

3.1  Analysis  of  Communication  Elements 

A  total  of  13,900  ATCS  transmissions  (TRACON- 
1:  6,100  and  TRACON-2:  7,800)  consisting  of 
33,000®  communication  elements  from  the  simula¬ 
tion  tapes  were  compared  with  field  taped  transmis¬ 
sions.  There  were  1,900  ATCS  transmissions 
(TRACON-1:  1431  and  TRACON-2:  469)  consist¬ 
ing  of  5,336  communication  elements  from  the  field 
tapes.  All  transmissions  were  analyzed  in  accordance 
with  ATSAT^p procedures  (Prinzo  et  al.,  1995).  Table 
4  presents  the  distribution  of  the  total  number  of 
communication  elements  within  each  speech  act  cat¬ 
egory  by  tape  source.  The  majority  of  communication 
elements  appeared  in  the  Address  and  Instruction 
followed  by  Advisory  and  Request  speech  act  catego¬ 
ries.  Communication  elements  in  the  Courtesy  and 
Non-Codable  speech  act  categories  were  absent  from 
the  simulation  transmissions  and  virtually  absent  from 
the  field  communications  (5%  and  4%  respectively). 


TABLE  4.  Distribution  of  All  Communication  Elements  Within  Each  Speech  Act  Category 


Speech  Act  Category 

FIELD  TAPE  (5,336) 

SIMULATION  TAPE  (33,045) 

Address 

36% 

47% 

Instruction 

36% 

43% 

Advisory 

16% 

9% 

Request 

2% 

1% 

Courtesy 

5% 

0% 

Non-Codable 

4% 

0% 

^  Both  coders  were  retired  FPL  controllers. 

®  For  reading  ease,  numbers  have  been  rounded.  For  an  exact  count,  see  Appendix  A. 
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3.2  Analysis  of  Irregular  Communication 
Elements 

Nineteen  percent  of  the  simulation  and  40%  of  the 
field  tape  databases  contained  at  least  one  IC  code 
(i.e.,  communication  element  with  non-standard 
phraseology  or  irregular  delivery  technique).  Table  5 
shows  the  distribution  of  those  irregular  communica¬ 
tion  elements  within  each  speech  act  category  by  tape 
source.  The  majority  of  communication  elements  that 
contained  one  or  more  irregularities  involved  the 
Instruction  speech  act  category  for  both  the  field  and 
simulated  TRACON  environments  (55%  and  52%). 
In  comparing  Address  and  Advisory  speech  act  cat¬ 
egories,  there  were  more  irregular  communication 
elements  that  involved  the  Address  speech  act  cat- 
egory  produced  in  the  simulated  TRACON  environ¬ 
ment  and  more  irregular  communication  elements 
that  involved  the  Advisory  speech  act  category  pro¬ 
duced  at  real  TRACON  facilities.  For  both  TRACON 
environments,  less  than  5%  of  the  irregular  commu¬ 
nication  elements  involved  the  Request  speech  act. 

3.3  Analysis  of  Irregular  Communications.  The 
Wald-Wolfowitz  Runs  Test^  a  nonparametric  test  of 
the  null  hypothesis  that  two  samples  come  from  the 
same  population,  was  used  to  determine  whether  the 
simulation  and  field  tape  data  samples  differed  in  any 
respect  from  one  another.  The  Runs  Test  requires  that 
data  from  both  samples  are  combined,  ranked  from 


smallest  to  largest,  and  the  number  of  runs^®  in  the 
distribution  counted.  The  computed  value  is  com¬ 
pared  to  an  expected  value  obtained  from  a  statistical 
table  in  which  various  sample  sizes  and  probabilities 
are  presented.  If  the  computed  value  is  larger  than  the 
expected  value,  then  the  null  hypothesis  is  rejected. 
When  the  null  hypothesis  is  rejected,  it  indicates  that 
the  two  groups  differ  in  some  measurable  way.  Sepa¬ 
rate  Runs  Tests  were  performed  on  the  total  number 
of  Instruction,  Advisory,  and  Request  ICs  with  p  = 
.05.  Since  the  ATCSs’  communications  during  simu¬ 
lation  were  expected  be  the  same  or  similar  to  those  on 
the  field  tape,  it  was  expected  that  the  Runs  Tests 
would  be  non-significant. 

Since  each  irregular  communication  element  could 
contain  a  maximum  of  three  IC  codes,  the  total 
number  of  IC  codes  could  exceed  the  number  of 
irregular  communication  elements.  Irregular  Com¬ 
munication  that  involved  the  Courtesy  and  Non- 
Codable  speech  act  categories  accounted  for  less  than 
1  %  of  the  total  distribution  and  were  omitted  from  all 
figures.  The  percentage  for  each  type  of  IC  was  calcu¬ 
lated  separately  for  field  and  simulation  tapes  using 
the  formula  presented  below: 

Percentage  Irregular  Communications  = 

Z  Aviation  Topic  Speech  Act  IC 
E  Address  ICs 


^  For  brevity,  the  Wald-Walfowitz  Runs  Test  will  be  referred  to  as  The  Runs  Test. 

Runs  are  defined  as:  any  sequence  of  scores  from  the  same  group  (either  from  the  simulation  or  field  tape). 
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For  example,  34%  of  the  (104/307)  ICs  within  the 
Address  speech  act  category  involved  the  omission  of 
part  of  the  Receiver  ID  aviation  topic  from  field  tapes 
(see  Appendix  C). 

3.3.  lAddress.  The  data  presented  in  Figure  2  indi¬ 
cate  that  the  majority  of  Address  ICs  involved  the 
receiver  identification  (i.e.,  aircraft  call  sign).  It  was 
expected  that  there  would  be  considerably  fewer  ICs 
that  involved  the  Speaker  ID,  especially  since  there  are 
fewer  sector  names  (i.e.,  Tower,  Approach  Control, 
Center)  that  are  prefaced  with  location  or  facility 
names  and  sector  functions  (e.g.,  ground,  local,  de¬ 
parture,  approach)  when  compared  with  the  number 
and  type  of  aircraft  flying  in  terminal  airspace  daily. 

A  Runs  Test  performed  on  the  frequency  of  each 
type  of  irregular  communication  for  Receiver  ID  was 
significant,  r  =  6,  z  =  -1.702,  p  =  .04.  As  shown  in 


Figure  3,  there  were  proportionally  more  omissions 
on  field  tapes  than  on  tapes  from  the  simulation 
laboratory.  The  omitted  information  could^  be  a 
word(s)  such  as  “heavy,”  type,  model,  name,  etc.  or 
number(s).  Following  initial  radar  contact,  control¬ 
lers  might  reply  to  a  second  transmission  by  simply 
saying,  “four  three  Charlie”  instead  of  “November 
four  three  Charlie.”  In  the  field,  pilots  are  more  likely 
to  respond  to  an  abbreviated  call  sign  and,  controllers 
knowing  this,  will  omit  portions  of  the  call  sign  as  a 
strategy  to  minimize  their  time  on  an  already  con¬ 
gested  radio  frequency.  Applying  this  strategy  during 
simulated  conditions  was  counter-productive.  The 
computer's  voice  recognition  system  would  fail,  forc¬ 
ing  the  controller  to  repeat  the  transmission.  Repeat¬ 
ing  the  transmission  added  to  the  controller's  workload 
and  frequency  congestion. 


Figure  2.  Distribution  of  Aviation  Topics  in  the  Address  Speech  Act  Category 
That  Contained  Irregular  Communications 
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Figure  3.  Distribution  of  Field  and  Simulation  Address  Irregular  Communications 


For  simulated  traffic,  controllers  made  proportion¬ 
ally  more  ICs  that  involved  how  numbers  were  spo¬ 
ken' f  For  example,  flight  numbers  in  an  air  carrier's 
call  sign  are  to  be  spoken  in  grouped  format  and  for 
general  aviation  aircraft,  the  numbers  of  the  aircraft 
registration  are  to  be  spoken  sequentially.  As  stated  in 
FAA  Order  7110.65,  “'Group  form'  is  the  pronuncia¬ 
tion  of  a  series  of  numbers  as  the  whole  number,  or 
pairs  of  numbers  they  represent  rather  than  pronounc¬ 
ing  each  separate  digit  [sic].”  For  example,  a  descent 
instruction  to  the  pilot  of  SWA943  should  have  been 
spoken  as  “Southwest  Nine  Forty-three  descend  and 
maintain 

‘‘  See  FAA  Order  71 10.65  2-4  Aircraft  Identification. 


3.3.2Instruction.  Figure  4  reveals  that,  for  field 
communication,  the  majority  of  Instruction  ICs  in¬ 
volved  Radio  Frequency,  Speed,  and  Heading  avia¬ 
tion  topics.  For  simulated  communication,  ICs 
occurred  most  frequently  in  the  Approach/Departure, 
Radio  Frequency,  and  Heading  aviation  topics.  How¬ 
ever,  these  differences  were  not  statistically  signifi¬ 
cant,  r  =  1 1,  z  =  -.218,y>  >  .4.  Based  on  the  outcome 
of  the  Runs  Test,  it  was  concluded  that  the  simulation 
results  were  representative  of  the  communication  ir¬ 
regularities  identified  from  field  tapes. 

A  Runs  Test  was  performed  on  the  field-  and 
simulation-tape  distributions  of  IC  codes  (i.e., 
grouped,  sequential,  and  so  on).  Overall,  there  was  no 
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Figure  4.  Distribution  of  Aviation  Topics  in  the  Instruction  Speech  Act  Category  that 

Contained  Irregular  Communications 


significant  difference  in  the  two  distributions,  r  = 
8,  z  =  '.729,  p  =  .47.  As  shown  in  Figures  5  and  6,  the 
most  frequent  IC  involved  the  omission  of  part  of  a 
Radio  Frequency.  Other  omissions  involved  Head¬ 
ing,  Altitude,  and  Speed.  In  the  transmission  “Ameri¬ 
can  Fourteen  Ninety  Heavy  contact  approach,”  the 
controller  failed  to  include  the  radio  frequency  in  the 
transfer  of  communication.  And  in  the  transmission, 
“...  expect  localizer  back  course  three  five  left  ap¬ 
proach,”  the  controller  omitted  the  word  “runway”  as 
part  of  the  advance  approach  information. 

3. 3. 3 Advisory.  As  shown  in  Figure  7,  Advisory  ICs 
involving  field  tapes  occurred  most  often  in  Ap¬ 
proach/Departure,  Weather,  and  Route/Position  avia¬ 
tion  topics.  For  simulated  communication,  Advisory 


ICs  occurred  most  frequently  in  Sighting,  Approach/ 
Departure,  and  General  Acknowledgment  aviation 
topics.  The  Runs  Test  revealed  that  the  distributions 
were  not  significantly  different  from  one  another  r  = 
9,  z  -1.092,  p  >  A,  and  it  was  concluded  that  the 
simulation  results  were  representative  of  the  commu¬ 
nication  problems  identified  from  field  tapes. 

As  shown  in  Figures  8  and  9,  excess-verbiage  was 
the  most  prevalent  IC  code  for  field  and  simulated 
communications.  Omissions  were  higher  on  the  field 
tapes  because  weather  was  a  factor  at  one  of  the 
facilities  and  traffic  was  heavy.  Under  those  condi¬ 
tions,  controllers  often  would  have  additional  de¬ 
mands  placed  on  them  by  pilots  who  want  to  be 
vectored  around  weather  cells.  On  one  field  tape. 
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Figure  7.  Distribution  of  Aviation  Topics  in  the  Advisory  Speech  Act 
That  Contained  Irregular  Communications 


moderate  turbulence  was  reported  by  a  pilot.  As  is 
often  the  case,  other  pilots  who  are  listening  in  on  the 
party  line  will  use  this  information  to  avoid  a  “rough 
ride,”  Upon  hearing  other  pilots’  reports,  they  too  will 
get  on  the  radio  frequency  to  either  report  current 
weather  conditions  and/or  request  deviations  from 
their  flight  plan  if  weather  seems  to  be  a  potential 
factor  in  their  approved  flight  plans.  These  additional 
communications  increase  frequency  congestion  in  an 
already  complex  situation  and  add  to  the  controllers’ 
workload.  As  an  example  of  weather-related  commu¬ 
nications,  a  portion  of  communications  between  a 
controller  and  several  different  pilots  is  presented 
below. 

^'Company  went  through  the  weather  [aircraft] 
straight  ahead  he  said  ten  second  [sic]  of  moderate 
turbulence  the  rest  was  light  chop,  [aircraft]  approach 
roger  Vm  gonna  let  you  find  an  area  where  you  d  like  to 
turn  to  the  northwest  and  get  through  the  weather  uh 


company  said  there  was  ten  seconds  of  moderate  turbu¬ 
lence  in  the  weather  off  to  your  right  and  the  rest  was 
light  chop  then  a  [aircraft]  went  through  there  and  said 
that  they  were  really  getting  down  drafts  in  that.  Roger 
[aircraft]  ok  thank  you  let  me  know  how  the  ride  is  over 
the  next  five  miles  or  so  you  should  be  west  of  that  well 
about  ten  miles  you  should  be  west  of  the  weather.  Er 
[aircraft] you  re  eight  miles  behind  [aircraft]  increase  to 
two  zero  zero  if  you  like.  If  the  weather  permits  [air¬ 
craft]  the  [airport]  weather  is  five  thousand  scattered 
higher  ceiling  broken  visibility  one  five  wind  three  four 
zero  at  six  altimeter  two  niner  seven  six  expect  runway 
three  four  right  or  left.  ” 

Although  weather  was  not  a  factor  in  the  simula¬ 
tion  study,  the  ghost  pilot  did  request  a  speed  reduc¬ 
tion  because  of  mild  chop.  In  the  transmission, 
“American  Thirteen  Eighty-  One  Heavy,  you  can 
expect  visual  runway  three  five  right  approach,”  the 
phrase  “you  can”  was  coded  as  excess-verbiage.  Since 
other  ghost  pilots  were  not  present  to  make  similar 
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requests  of  the  controller,  there  were  fewer  opportuni'  aviation  topics.  The  Runs  Test  revealed  that  the 

tiesforthecontroller  to  issue  deviations  due  to  weather.  distributions  were  not  significantly  different  8, 

A  Runs  Test  performed  on  the  field-  and  simulation  z  =  0,y>  >  .6,  and  it  was  concluded  that  the  simulation 

distributions  of  irregular  communication  codes  (e.g.,  results  were  representative  of  the  communication  prob- 

grouped,  sequential,  and  so  on)  was  not  significant,  r  lems  identified  from  field  tapes. 

=  10,  z  =  0,  p  =  1.0.  This  result  indicated  that,  overall.  Given  the  small  number  of  irregular  communica- 

there  was  no  statistical  difference  in  the  types  of  tions  it  was  not  possible  to  perform  a  Runs  Test  on  the 
irregular  communications  produced  by  controllers  two  distributions  of  types  of  irregular  communica- 
whether  in  the  field  or  simulation  laboratory.  tions.  As  shown  in  Figure  1 1,  the  majority  of  the  field 

3.3.4Request.  It  is  important  to  remember  that  ICs  involved  substitutions  and/or  excess-verbiage 

only  2%  of  ah  the  communication  elements  made  by  (36%  Substitutions  and  38%  Excess-verbiage  summed 

controllers  in  the  field  and  in  the  simulation  labora-  across  aviation  topic).  For  example,  in  the  transmis- 

tory  involved  Requests,  and  only  3-4%  contained  s ion,  “American  Fourteen  Zero  Eight  Heavy  ^^mj5'head- 

ICs.  Figure  10  shows  that,  for  field  tapes,  the  majority  ing,”  “verify”  was  coded  as  a  substitution  for  the  word 

of  controller  Request  ICs  involved  Speed  and  Altitude  “say.”  The  controller  should  have  said,  “American  Four- 

aviation  topics.  For  simulated  communication,  the  teen  Zero  Eight  Heavy,  say  heading.”  Figure  12  shows 
majority  of  aviation  topics  involved  General  Acknowl-  that,  for  simulated  communications,  37%  of  the  excess- 

edgment  followed  by  Approach/Departure  and  Altitude  verbiage  ICs  involved  General  Acknowledgments. 


Figure  10.  Distribution  of  Aviation  Topics  in  the  Request  Speech  Act  Category 
That  Contained  Irregular  Communications 
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4.0  DISCUSSION 

Following  the  installation  of  radio  communica¬ 
tions  equipment  in  the  Cleveland,  Ohio  control  tower 
in  1936,  radio  communication  became  the  primary 
means  of  relaying  information  between  controller 
and  pilots  in  the  domestic  air  traffic  control  syste- 
m.  Communication  is  an  integral  component  in  an  air 
traffic  controller’s  ability  to  maintain  separation  be¬ 
tween  aircraft  and  obstacles.  A  standard  phraseology 
was  developed  by  the  FAA  to  ensure  that  miscommu- 
nication  was  kept  to  a  minimum.  Likewise,  to  reduce 
the  possibility  of  mishearing  similarly  sounding  num¬ 
bers  and/or  letters,  a  standard  for  pronunciation  was 
developed.  Both  are  included  in  FAA  Order  7110.65 
Air  Trajftc  Control.  This  standard  was  applied  to  the 
analysis  of  controller  communication  derived  from  field 
and  simulation  tapes  that  were  transcribed  verbatim. 

There  were  three  sets  of  analyses  performed  on  the 
data.  The  overall  analysis  of  all  communication  elements 
revealed  the  percentages  of  Address,  Instruction,  Advi¬ 
sory,  and  Request  speech  acts  within  each  database  to  be 
very  similar.  Only  Courtesy  and  Non-codable  commu¬ 
nication  elements  were  present  on  field  tapes.  Courtesy 
speech  acts  often  signaled  pilots  that  the  transaction  was 
completed  (much  like  saying  good-bye)  and  radio  com¬ 
munication  switched  to  another  controller.  Courtesy 
speech  acts  during  simulation  were  misinterpreted  by  the 
Verbex  voice  recognition  system  and  controllers  were 
provided  the  opportunity  to  experience  this  first-hand 
during  training.  It  is  not  surprising  that  Non-codable 
communication  elements  appeared  on  field  tapes  be¬ 
cause  tapes  become  unclear  and  unintelligible  as  they  are 
reused  and  then  duplicated  onto  recycled  cassettes.  Simu¬ 
lated  communication  was  always  recorded  onto  new 
cassette  tapes. 

The  second  set  of  analyses  examined  only  irregular 
communication  elements.  The  primary  difference 
between  field  and  simulation  communication  was 
that  there  were  21%  fewer  irregular  communications 
produced  by  controllers  during  simulation  than  in  the 
field.  There  are  several  reasons  why  this  occurred. 
First,  although  controllers  are  required  to  use  FAA 
standard  phraseology  in  the  field,  this  requirement 
was  stressed  by  the  SME  during  Verbex  voice  training 
and  practice  using  the  TRACONsim.  Also,  a  note  was 
posted  at  the  workstation  to  remind  the  controller  to 


use  required  phraseology.  Second,  controllers  knew 
the  Verbex  voice  recognition  system  would  not  work 
properly  unless  that  standard  was  applied  throughout 
the  simulation.  Third,  prior  to  the  onset  of  the  first 
simulation,  each  controller  received  extensive  prac¬ 
tice  with  the  voice  recognition  system  and  the  oppor¬ 
tunity  to  correct  irregular  communication;  and  lastly, 
controllers  were  aware  that  their  communication  would 
be  audio-  and  video-recorded.  Results  of  studies  on 
social  facilitation,  brought  on  by  the  observation  of 
behavior  by  spectators  (i.e.,  audience  effects),  indi¬ 
cated  that  when  participants  knew  they  were  being 
observed  on  tasks  in  which  they  were  skilled,  their 
vigilance  and  performance  improved  (Triplett,  1897; 
see  the  review  article  by  Zajonc,  1965).  Knowing  that 
they  were  being  recorded  contributed  to  the  improved 
performance  of  controllers  in  this  study.  The  second¬ 
ary  finding,  revealed  by  the  Runs  Tests,  was  that  the 
distributions  of  irregular  communication  elements 
(distributions  of  aviation  topics)  within  each  of  the 
speech  act  categories  were  not  significantly  different 
for  field  and  simulation  communications.  Thus,  al¬ 
though  there  were  fewer  irregular  communication 
elements  that  were  produced  under  simulated  condi¬ 
tions,  the  distribution  of  those  elements  were  much 
the  same  as  those  in  the  field. 

The  final  set  of  analyses  examined  the  field-  and 
simulation  tape  distributions  of  the  8  types  of  irregular 
communication  codes  (grouped,  sequential,  and  so  on). 
Given  the  type  and  complexity  of  the  irregular  commu¬ 
nications,  only  a  global  test  was  performed  on  the 
Receiver  ID  aviation  topic,  and  the  Instruction,  and 
Advisory  speech  act  categories.  Requests  were  excluded 
because  there  was  insufficient  data  with  which  to  per¬ 
form  an  analysis.  Only  the  distribution  of  irregular 
communication  codes  for  Receiver  ID  differed  from  the 
field  communications.  This  finding  is  easily  explained. 
In  the  field,  controllers  know  that  pilots  will  communi¬ 
cate  with  them  even  if  a  portion  of  the  aircraft  call  sign 
is  omitted'^  During  simulation  training,  controllers 
quickly  learned  that  omitting  a  part  of  the  aircraft  call 
sign  often  required  them  to  re-transmit  the  entire  mes¬ 
sage.  The  Verbex  voice  recognition  system  was  less 
forgiving  than  a  pilot.  Knowing  that  omitting  a  portion 
of  the  aircraft  call  sign  would  increase  their  workload  was 
effective  in  reinforcing  the  importance  of  including  the 
entire  call  sign  in  a  message. 


Often,  while  pilots  are  listening  on  their  assigned  radio  frequency,  they  will  question  the  controller  about  a  transmitted  message 
if  the  numbers  in  the  call  sign  are  similar  to  their  own. 
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5.0  CONCLUSION 

The  overall  research  findings  indicated  the  control¬ 
lers  generally  communicate  with  the  simulation  pilots 
in  ways  that  are  consistent  with  how  they  communi¬ 
cate  with  pilots  at  their  TRACON  facilities.  Although 
there  were  proportionately  fewer  irregular  communi¬ 
cation  elements  produced  during  simulation,  the  dis¬ 
tribution  of  those  irregularities  was  consistent  with 
those  produced  in  the  field.  This  conclusion  also 
holds  true  of  irregular  communication  codes  for  In¬ 
struction  and  Advisory  speech  act  categories.  Simula¬ 
tion  can  be  a  useful  tool  to  address  issues  associated 
with  the  effects  of  changes  in  procedures  and  technol¬ 
ogy  on  the  communication  process. 

The  use  of  voice  recognition  technology  can  be 
instrumental  in  teaching  and  reinforcing  basic  air 
traffic  control  phraseology  as  demonstrated  by  the 
fewer  irregular  communications  produced  by  control¬ 
lers  once  trained  on  the  VERB  EX  voice  recognition 
system.  A  limitation  of  the  technology  is  that  it  is  not 
advanced  enough  to  accommodate  everyday  language 
usage.  Sometimes  it  is  necessary  for  controllers  to 
restate  numbers  spoken  sequentially  in  a  call  sign, 
instruction,  advisory,  or  request  in  a  grouped  format 
for  emphasis  or  clarification.  Although  pilots  easily 
understand  what  is  spoken,  current  voice  recognition 
capabilities  lag  behind. 
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